The performance of human cytomegalovirus digital PCR reference measurement procedure in seven external quality assessment schemes over four years.

A candidate digital PCR (dPCR)-based reference measurement procedure for quantification of human cytomegalovirus (hCMV) was evaluated in 10 viral load comparison schemes (seven external quality assessment (EQA) and three additional training schemes) organized by INSTAND e.V. over four years (between September 2014 and March 2018). Four metrology institutes participated in these schemes using the same extraction method and dPCR measurement procedure for the hCMV specific target sequence of UL54 gene. The calibration independent reference measurement procedure results from the metrology institutes were compared to the results of the clinical diagnostic laboratories applying hCMV qPCR measurement procedures calibrated to reference materials. While the criteria for the acceptable deviation from the target value interval for INSTAND's EQA schemes is from -0.8 log10 to +0.8 log10, the majority of dPCR results were between -0.2 log10 to +0.2 log10. Only 4 out of 45 results exceeded this interval with the maximum deviation of -0.542 log10. In the training schemes containing samples with lower hCMV concentrations, more than half of the results deviated less than ±0.2 log10 from the target value, while more than 95% deviated less than ±0.4 log10 from the target value. Evaluation of intra- and inter-laboratory variation of dPCR results confirmed high reproducibility and trueness of the method. This work demonstrates that dPCR has the potential to act as a calibration independent reference measurement procedure for the value assignment of hCMV calibration and reference materials to support qPCR calibration as well as ultimately for routine hCMV load testing.

First amyloid ß1-42 certified reference material for re-calibrating commercial immunoassays.

INTRODUCTION: Reference materials based on human cerebrospinal fluid were certified for the mass concentration of amyloid beta (Aß)1-42 (Aß42 ). They are intended to be used to calibrate diagnostic assays for Aß42 . METHODS: The three certified reference materials (CRMs), ERM-DA480/IFCC, ERM-DA481/IFCC and ERM-DA482/IFCC, were prepared at three concentration levels and characterized using isotope dilution mass spectrometry methods. Roche, EUROIMMUN, and Fujirebio used the three CRMs to re-calibrate their immunoassays. RESULTS: The certified Aß42 mass concentrations in ERM-DA480/IFCC, ERM-DA481/IFCC, and ERM-DA482/IFCC are 0.45, 0.72, and 1.22 µg/L, respectively, with expanded uncertainties (k = 2) of 0.07, 0.11, and 0.18 µg/L, respectively. Before re-calibration, a good correlation (Pearson's r > 0.97), yet large biases, were observed between results from different commercial assays. After re-calibration the between-assay bias was reduced to < 5%. DISCUSSION: The Aß42 CRMs can ensure the equivalence of results between methods and across platforms for the measurement of Aß42 .

IFCC Working Group Recommendations for Correction of Bias Caused by Noncommutability of a Certified Reference Material Used in the Calibration Hierarchy of an End-User Measurement Procedure.

Establishing metrological traceability to an assigned value of a matrix-based certified reference material (CRM) that has been validated to be commutable among available end-user measurement procedures (MPs) is central to producing equivalent results for the measurand in clinical samples (CSs) irrespective of the clinical laboratory MPs used. When a CRM is not commutable with CSs, the bias due to noncommutability will be propagated to the CS results causing incorrect metrological traceability to the CRM and nonequivalent CS results among different MPs. In a commutability assessment, a conclusion that a CRM is commutable or noncommutable for use with a specific MP is made when the difference in bias between the CRM and CSs meets or does not meet a criterion for that specific MP when compared to other MPs. A conclusion regarding commutability or noncommutability requires that the magnitude of the difference in bias observed in the commutability assessment remains unchanged over time. This conclusion requires the CRM to be stable and no substantive changes in the MPs. These conditions should be periodically reverified. If an available CRM is determined to be noncommutable for a specific MP, that CRM can be used in the calibration hierarchy for that MP when an appropriately validated MP-specific correction for the noncommutability bias is included. We describe with examples how a MP-specific correction and its uncertainty can be developed and applied in a calibration hierarchy to achieve metrological traceability of results for CSs to the CRM's assigned value.

Certified reference material against PR3 ANCA IgG autoantibodies. From development to certification.

Background The importance of the standardisation of immunoassays for autoantibodies has been widely discussed. The appropriate use of certified reference materials (CRM) could contribute to a more accurate diagnosis and follow-up of a series of diseases such as small vessel-associated vasculitis. This is a systemic autoimmune disorder during which two autoantibodies can be present, MPO ANCA IgG and PR3 ANCA IgG. Results from different commercially available immunoassays used for PR3 ANCA IgG measurement can vary significantly. Therefore the potential for improvement using a suitable certified reference material was assessed and led to the development of a CRM. Methods Thirty clinical samples were evaluated using 10 immunoassays. The correlation between results from these assays was assessed in a pairwise manner. Feasibility studies were conducted in order to find a reference material format most suitable for the preparation of a CRM. Results The evaluation of two sets of 30 clinical samples with 10 assays showed that differences between assays can result in different interpretations for individual clinical samples. Most of the samples had the same result classification in all assays. However, six of the samples tested led to inconsistent results. Conclusions The correlation between results from clinical samples was systematically good for combinations of eight of those assays. Therefore, it should be possible to improve the comparability of results using a commutable CRM for calibration. Based on these studies, a final format for the CRM was selected and eventually produced and certified for its PR3 ANCA IgG content.

Commutability Assessment of Candidate Reference Materials for Pancreatic α-Amylase.

BACKGROUND: Measurement standardization of the catalytic concentration of α-amylase in serum is based on 3 pillars: the primary reference measurement procedure (PRMP), reference laboratories, and suitable certified reference materials (CRMs). Commutability is a prerequisite when using a CRM for calibration and trueness control of routine methods or for value transfer from the PRMP to end-user calibrators of routine methods through a calibration hierarchy. METHODS: We performed a commutability study with 30 serum pools and 5 candidate reference materials (RMs) for pancreatic α-amylase using an automated version of the PRMP and 5 different routine methods. Four candidate RMs had an artificial matrix, each with a different composition, and 1 candidate RM was based on human serum. Data were analyzed according to a linear regression analysis with prediction interval as described in the Clinical and Laboratory Standards Institute guideline EP30-A and a difference in bias analysis as described in the recommendations of the IFCC Working Group on Commutability. RESULTS: The commutability profile of the 4 candidate RMs with an artificial matrix was variable. Only 1 candidate RM, with human serum albumin in the matrix, showed a good profile like that of the candidate RM based on serum. The comparison of both commutability assessment approaches indicated some differences because of inconclusive results for the difference in bias approach, suggesting a large uncertainty on the commutability assessment. CONCLUSIONS: A CRM for pancreatic amylase in an artificial matrix can be commutable for routine methods using the same substrate as the PRMP, but the matrix composition is crucial.

IFCC Working Group Recommendations for Assessing Commutability Part 1: General Experimental Design.

Commutability is a property of a reference material (RM) that relates to the closeness of agreement between results for an RM and results for clinical samples (CSs) when measured by ≥2 measurement procedures (MPs). Commutability of RMs used in a calibration traceability scheme is an essential property for them to be fit for purpose. Similarly, commutability of trueness controls or external quality assessment samples is essential when those materials are used to assess trueness of results for CSs. This report is part 1 of a 3-part series describing how to assess commutability of RMs. Part 1 defines commutability and addresses critical components of the experimental design for commutability assessment, including selection of individual CSs, use of pooled CSs, qualification of MPs for inclusion, establishing criteria for the determination that an RM is commutable, generalization of commutability conclusions to future measurements made with the MPs included in the assessment, and information regarding commutability to be included in the certificate for an RM. Parts 2 and 3 in the series present 2 different statistical approaches to commutability assessment that use fixed criteria related to the medical decisions that will be made using the laboratory test results.

IFCC Working Group Recommendations for Assessing Commutability Part 3: Using the Calibration Effectiveness of a Reference Material.

A process is described to assess the commutability of a reference material (RM) intended for use as a calibrator based on its ability to fulfill its intended use in a calibration traceability scheme to produce equivalent clinical sample (CS) results among different measurement procedures (MPs) for the same measurand. Three sources of systematic error are elucidated in the context of creating the calibration model for translating MP signals to measurand amounts: calibration fit, calibrator level trueness, and commutability. An example set of 40 CS results from 7 MPs is used to illustrate estimation of bias and variability for each MP. The candidate RM is then used to recalibrate each MP, and its effectiveness in reducing the systematic error among the MPs within an acceptable level of equivalence based on medical requirements confirms its commutability for those MPs. The RM is declared noncommutable for MPs for which, after recalibration, the CS results do not agree with those from other MPs. When a lack of agreement is found, other potential causes, including lack of calibration fit, should be investigated before concluding the RM is noncommutable. The RM is considered fit for purpose for those MPs where commutability is demonstrated.

IFCC Working Group Recommendations for Assessing Commutability Part 2: Using the Difference in Bias between a Reference Material and Clinical Samples.

A process is described to assess the commutability of a reference material (RM) intended for use as a calibrator, trueness control, or external quality assessment sample based on the difference in bias between an RM and clinical samples (CSs) measured using 2 different measurement procedures (MPs). This difference in bias is compared with a criterion based on a medically relevant difference between an RM and CS results to make a conclusion regarding commutability. When more than 2 MPs are included, the commutability is assessed pairwise for all combinations of 2 MPs. This approach allows the same criterion to be used for all combinations of MPs included in the assessment. The assessment is based on an error model that allows estimation of various random and systematic sources of error, including those from sample-specific effects of interfering substances. An advantage of this approach is that the difference in bias between an RM and the average bias of CSs at the concentration (i.e., amount of substance present or quantity value) of the RM is determined and its uncertainty estimated. An RM is considered fit for purpose for those MPs for which commutability is demonstrated.

Inter-laboratory assessment of different digital PCR platforms for quantification of human cytomegalovirus DNA.

Quantitative PCR (qPCR) is an important tool in pathogen detection. However, the use of different qPCR components, calibration materials and DNA extraction methods reduces comparability between laboratories, which can result in false diagnosis and discrepancies in patient care. The wider establishment of a metrological framework for nucleic acid tests could improve the degree of standardisation of pathogen detection and the quantification methods applied in the clinical context. To achieve this, accurate methods need to be developed and implemented as reference measurement procedures, and to facilitate characterisation of suitable certified reference materials. Digital PCR (dPCR) has already been used for pathogen quantification by analysing nucleic acids. Although dPCR has the potential to provide robust and accurate quantification of nucleic acids, further assessment of its actual performance characteristics is needed before it can be implemented in a metrological framework, and to allow adequate estimation of measurement uncertainties. Here, four laboratories demonstrated reproducibility (expanded measurement uncertainties below 15%) of dPCR for quantification of DNA from human cytomegalovirus, with no calibration to a common reference material. Using whole-virus material and extracted DNA, an intermediate precision (coefficients of variation below 25%) between three consecutive experiments was noted. Furthermore, discrepancies in estimated mean DNA copy number concentrations between laboratories were less than twofold, with DNA extraction as the main source of variability. These data demonstrate that dPCR offers a repeatable and reproducible method for quantification of viral DNA, and due to its satisfactory performance should be considered as candidate for reference methods for implementation in a metrological framework.

Development of a Certified Reference Material for myeloperoxidase-anti-neutrophil cytoplasmic autoantibodies (MPO-ANCA).

A serum Certified Reference Material (CRM) for supporting reliable autoimmune diagnostics was recently released by the Institute for Reference Materials and Measurements (IRMM) of the Joint Research Centre of the European Commission. It was produced in collaboration with a Working Group on the Harmonisation of Autoimmune Tests of the International Federation of Clinical Chemistry and Laboratory Medicine (IFCC WG-HAT). This material is aimed at facilitating the standardisation of measurements of anti-myeloperoxidase immunoglobulin G antibodies. The CRM could be used as a common calibrant by clinicians and manufacturers thereby significantly improving the comparability of results from commercial immunoassays used for IgG anti-MPO measurements. This paper provides information on the new CRM and its intended use.

CSF Aß1-42 - an excellent but complicated Alzheimer's biomarker - a route to standardisation.

The 42 amino acid form of amyloid ß (Aß1-42) in cerebrospinal fluid (CSF) has been widely accepted as a central biomarker for Alzheimer's disease. Several immunoassays for CSF Aß1-42 are commercially available, but can suffer from between laboratory and batch-to-batch variability as well as lack of standardisation across assays. As a consequence, no general cut-off values have been established for a specific context of use (e.g., clinical diagnostics) and selection of individuals for enrolment in clinical trials (patient stratification) remains challenging. The International Federation of Clinical Chemistry and Laboratory Medicine (IFCC) has initiated a working group for CSF proteins (WG-CSF) to facilitate standardisation of CSF Aß1-42 measurement results. The efforts of the IFCC WG-CSF include the development of certified reference materials (CRMs) and reference measurement procedures (RMPs) for key biomarkers. Two candidate RMPs for quantification of Aß1-42 in CSF based on liquid chromatography tandem mass spectrometry have been developed and tested in two ring trials. Furthermore, two commutability studies including native CSF pools, artificial CSF and spiked materials have been completed. On the basis of these studies, human CSF pools containing only endogenous Aß1-42 at three concentrations were selected as the format for future CRMs that are now being processed.

Influence of primer & probe chemistry and amplification target on reverse transcription digital PCR quantification of viral RNA.

Compared to other PCR technologies, digital PCR is a potentially highly accurate approach for the quantification of nucleic acid fragments. This study describes the impact of four experimental factors, namely primer and probe chemistry, PCR amplification target, duplexing, and template type, on the measurement results obtained by reverse transcription digital PCR (RT-dPCR) of viral RNA using influenza A virus as a model. Along conventional dual labelled probes (DLP), alternative primer and probe chemistries, including Zip Nucleic Acids (ZNAs), Locked Nucleic Acids (LNAs), and Scorpions(®), were compared with two RNA template types: i) total genomic RNA extracted from cell cultured influenza A and ii) a synthetically prepared RNA transcript (In vitro transcribed RNA). While apparently duplexing or a different PCR target choice did not have a significant influence on the estimated RNA copy numbers, the impact of the choice of primer and probe chemistry and template type differed significantly for some methods. The combined standard uncertainty of the dPCR analysis results has been assessed, taking into account both the repeatability and the intermediate precision of the procedure. Our data highlight the importance of dPCR method optimisation and the advantage of using a more sophisticated primer and probe chemistry, which turned out to be dependent on the template type. Considerations are provided with respect to the molecular diagnostics of viral RNA pathogens, and more specifically, for precise quantification of RNA, which is of tremendous importance for the development of RNA calibration materials and the qualification of these calibrants as certified reference materials.

The use of digital PCR to improve the application of quantitative molecular diagnostic methods for tuberculosis.

BACKGROUND: Real-time PCR (qPCR) based methods, such as the Xpert MTB/RIF, are increasingly being used to diagnose tuberculosis (TB). While qualitative methods are adequate for diagnosis, the therapeutic monitoring of TB patients requires quantitative methods currently performed using smear microscopy. The potential use of quantitative molecular measurements for therapeutic monitoring has been investigated but findings have been variable and inconclusive. The lack of an adequate reference method and reference materials is a barrier to understanding the source of such disagreement. Digital PCR (dPCR) offers the potential for an accurate method for quantification of specific DNA sequences in reference materials which can be used to evaluate quantitative molecular methods for TB treatment monitoring. METHODS: To assess a novel approach for the development of quality assurance materials we used dPCR to quantify specific DNA sequences in a range of prototype reference materials and evaluated accuracy between different laboratories and instruments. The materials were then also used to evaluate the quantitative performance of qPCR and Xpert MTB/RIF in eight clinical testing laboratories. RESULTS: dPCR was found to provide results in good agreement with the other methods tested and to be highly reproducible between laboratories without calibration even when using different instruments. When the reference materials were analysed with qPCR and Xpert MTB/RIF by clinical laboratories, all laboratories were able to correctly rank the reference materials according to concentration, however there was a marked difference in the measured magnitude. CONCLUSIONS: TB is a disease where the quantification of the pathogen could lead to better patient management and qPCR methods offer the potential to rapidly perform such analysis. However, our findings suggest that when precisely characterised materials are used to evaluate qPCR methods, the measurement result variation is too high to determine whether molecular quantification of Mycobacterium tuberculosis would provide a clinically useful readout. The methods described in this study provide a means by which the technical performance of quantitative molecular methods can be evaluated independently of clinical variability to improve accuracy of measurement results. These will assist in ultimately increasing the likelihood that such approaches could be used to improve patient management of TB.

Certified reference materials for testing of the presence/absence of Staphylococcus aureus enterotoxin A (SEA) in cheese.

Staphylococcal enterotoxins (SEs) account for a substantial number of food-poisoning outbreaks. European legislation (Commission Regulation 1441/2007) stipulates the reference procedure for SE analysis in milk and dairy products, which is based on extraction, dialysis concentration and immunochemical detection using one of two approved assays (VIDAS(®) SET2, Ridascreen(®) SET Total). However, certified reference materials (CRMs) are lacking to support laboratories in performing reliable detection of Staphylococcus aureus enterotoxin A (SEA) in relevant matrices at sub-nanogram per gram levels. The certification of a set of three reference materials (blank and two SEA-containing materials) for testing of the presence/absence of SEA in cheese is described. The reference procedure was applied in an intercomparison with 15 laboratories, and results were reported in a qualitative manner (presence or absence of SEA in the sample). No false-negative or false-positive results were obtained. The certified values were stated as diagnostic specificity (blank material) or diagnostic sensitivity (SEA-containing materials) and were 100 % in all cases. Stability studies demonstrated suitable material stability when stored cooled or frozen. An in-house study on the recovery of SEA in the cheese materials using a double-sandwich enzyme-linked immunosorbent assay (ELISA) revealed comparable recovery values of around 45 % at the two spiking levels and in both the SEA-containing CRMs as well as blank CRM freshly spiked prior to analysis. The values were also comparable over time and among different analysts. The materials provide valuable support to laboratories for method validation and method performance verification and will increase the reliability of measuring SEA in cheese.

Qualitative and Quantitative Detection of Botulinum Neurotoxins from Complex Matrices: Results of the First International Proficiency Test.

In the framework of the EU project EQuATox, a first international proficiency test (PT) on the detection and quantification of botulinum neurotoxins (BoNT) was conducted. Sample materials included BoNT serotypes A, B and E spiked into buffer, milk, meat extract and serum. Different methods were applied by the participants combining different principles of detection, identification and quantification. Based on qualitative assays, 95% of all results reported were correct. Successful strategies for BoNT detection were based on a combination of complementary immunological, MS-based and functional methods or on suitable functional in vivo/in vitro approaches (mouse bioassay, hemidiaphragm assay and Endopep-MS assay). Quantification of BoNT/A, BoNT/B and BoNT/E was performed by 48% of participating laboratories. It turned out that precise quantification of BoNT was difficult, resulting in a substantial scatter of quantitative data. This was especially true for results obtained by the mouse bioassay which is currently considered as "gold standard" for BoNT detection. The results clearly demonstrate the urgent need for certified BoNT reference materials and the development of methods replacing animal testing. In this context, the BoNT PT provided the valuable information that both the Endopep-MS assay and the hemidiaphragm assay delivered quantitative results superior to the mouse bioassay.

An International Proficiency Test to Detect, Identify and Quantify Ricin in Complex Matrices.

While natural intoxications with seeds of Ricinus communis (R. communis) have long been known, the toxic protein ricin contained in the seeds is of major concern since it attracts attention of those intending criminal, terroristic and military misuse. In order to harmonize detection capabilities in expert laboratories, an international proficiency test was organized that aimed at identifying good analytical practices (qualitative measurements) and determining a consensus concentration on a highly pure ricin reference material (quantitative measurements). Sample materials included highly pure ricin as well as the related R. communis agglutinin (RCA120) spiked into buffer, milk and meat extract; additionally, an organic fertilizer naturally contaminated with R. communis shred was investigated in the proficiency test. The qualitative results showed that either a suitable combination of immunological, mass spectrometry (MS)-based and functional approaches or sophisticated MS-based approaches alone successfully allowed the detection and identification of ricin in all samples. In terms of quantification, it was possible to determine a consensus concentration of the highly pure ricin reference material. The results provide a basis for further steps in quality assurance and improve biopreparedness in expert laboratories worldwide.

Characterization of Ricin and R. communis Agglutinin Reference Materials.

Ricinus communis intoxications have been known for centuries and were attributed to the toxic protein ricin. Due to its toxicity, availability, ease of preparation, and the lack of medical countermeasures, ricin attracted interest as a potential biological warfare agent. While different technologies for ricin analysis have been established, hardly any universally agreed-upon "gold standards" are available. Expert laboratories currently use differently purified in-house materials, making any comparison of accuracy and sensitivity of different methods nearly impossible. Technically challenging is the discrimination of ricin from R. communis agglutinin (RCA120), a less toxic but highly homologous protein also contained in R. communis. Here, we established both highly pure ricin and RCA120 reference materials which were extensively characterized by gel electrophoresis, liquid chromatography-electrospray ionization-tandem mass spectrometry (LC-ESI MS/MS), and matrix-assisted laser desorption ionization-time of flight approaches as well as immunological and functional techniques. Purity reached >97% for ricin and >99% for RCA120. Different isoforms of ricin and RCA120 were identified unambiguously and distinguished by LC-ESI MS/MS. In terms of function, a real-time cytotoxicity assay showed that ricin is approximately 300-fold more toxic than RCA120. The highly pure ricin and RCA120 reference materials were used to conduct an international proficiency test.

Generation and Characterization of Six Recombinant Botulinum Neurotoxins as Reference Material to Serve in an International Proficiency Test.

The detection and identification of botulinum neurotoxins (BoNT) is complex due to the existence of seven serotypes, derived mosaic toxins and more than 40 subtypes. Expert laboratories currently use different technical approaches to detect, identify and quantify BoNT, but due to the lack of (certified) reference materials, analytical results can hardly be compared. In this study, the six BoNT/A1-F1 prototypes were successfully produced by recombinant techniques, facilitating handling, as well as improving purity, yield, reproducibility and biosafety. All six BoNTs were quantitatively nicked into active di-chain toxins linked by a disulfide bridge. The materials were thoroughly characterized with respect to purity, identity, protein concentration, catalytic and biological activities. For BoNT/A1, B1 and E1, serotypes pathogenic to humans, the catalytic activity and the precise protein concentration were determined by Endopep-mass spectrometry and validated amino acid analysis, respectively. In addition, BoNT/A1, B1, E1 and F1 were successfully detected by immunological assays, unambiguously identified by mass spectrometric-based methods, and their specific activities were assigned by the mouse LD50 bioassay. The potencies of all six BoNT/A1-F1 were quantified by the ex vivo mouse phrenic nerve hemidiaphragm assay, allowing a direct comparison. In conclusion, highly pure recombinant BoNT reference materials were produced, thoroughly characterized and employed as spiking material in a worldwide BoNT proficiency test organized by the EQuATox consortium.

Evaluation of standardization capability of current cardiac troponin I assays by a correlation study: results of an IFCC pilot project.

BACKGROUND: As a part of an International Federation of Clinical Chemistry and Laboratory Medicine (IFCC) project to prepare a commutable reference material for cardiac troponin I (cTnI), a pilot study evaluated current cTnI assays for measurement equivalence and their standardization capability. METHODS: cTnI-positive samples collected from 90 patients with suspected acute myocardial infarction were assessed for method comparison by 16 cTnI commercial assays according to predefined testing protocols. Seven serum pools prepared from these samples were also assessed. RESULTS: Each assay was assessed against median cTnI concentrations measured by 16 cTnI assays using Passing-Bablok regression analysis of 79 patient samples with values above each assay's declared detection limit. We observed a 10-fold difference in cTnI concentrations for lowest to highest measurement results. After mathematical recalibration of assays, the between-assay variation for patient samples reduced on average from 40% to 22% at low cTnI concentration, 37%-20% at medium concentration, and 29%-14% at high concentration. The average reduction for pools was larger at 16%, 13% and 7% for low, medium and high cTnI concentrations, respectively. Overall, assays demonstrated negligible bias after recalibration (y-intercept: -1.4 to 0.3 ng/L); however, a few samples showed substantial positive and/or negative differences for individual cTnI assays. CONCLUSIONS: All of the 16 commercial cTnI assays evaluated in the study demonstrated a significantly higher degree of measurement equivalence after mathematical recalibration, indicating that measurement harmonization or standardization would be effective at reducing inter-assay bias. Pooled sera behaved similarly to individual samples in most assays.